A Comparison of Marginal Likelihood Computation Methods
نویسنده
چکیده
In a Bayesian analysis, different models can be compared on the basis of the expected or marginal likelihood they attain. Many methods have been devised to compute the marginal likelihood, but simplicity is not the strongest point of most methods. At the same time, the precision of methods is often questionable. In this paper several methods are presented in a common framework. The explanation of the differences is followed by an application, in which the precision of the methods is tested on a simple regression model where a comparison with analytical results is possible. JEL classification: C11, C52, C63
منابع مشابه
Improving the Performance of Bayesian Estimation Methods in Estimations of Shift Point and Comparison with MLE Approach
A Bayesian analysis is used to detect a change-point in a sequence of independent random variables from exponential distributions. In This paper, we try to estimate change point which occurs in any sequence of independent exponential observations. The Bayes estimators are derived for change point, the rate of exponential distribution before shift and the rate of exponential distribution after s...
متن کاملEvaluation of marginal likelihoods via the density of states
Bayesian model comparison involves the evaluation of the marginal likelihood, the expectation of the likelihood under the prior distribution. Typically, this high-dimensional integral over all model parameters is approximated using Markov chain Monte Carlo methods. Thermodynamic integration is a popular method to estimate the marginal likelihood by using samples from annealed posteriors. Here w...
متن کاملMarkov Chain Monte Carlo methods: Implementation and comparison
The paper and presentation will focus on MCMC methods, implemented together in MC2Pack, an ox package which allows you to run a range of sampling algorithm (MH, Gibbs, Griddy Gibbs, Adaptive Polar Importance Sampling, Adaptive Polar Sampling, and Adaptive Rejection Metropolis Sampling) on a given posterior. Computation of the marginal likelihood for the model is also done automatically, allowin...
متن کاملSequential Monte Carlo in Model Comparison: Example in Cellular Dynamics in Systems Biology
Sequential Monte Carlo analysis of time series provides a direct approach to evaluating approximate model marginal likelihoods for model comparison. We exemplify this in studies of dynamic bacterial communication in systems biology, where a long sequence of state vectors follow a complicated nonlinear dynamic model with several defining biochemical parameters. MCMC methods do not mix well in th...
متن کاملNested Sampling for General Bayesian Computation
Nested sampling estimates directly how the likelihood function relates to prior mass. The evidence (alternatively the marginal likelihood, marginal density of the data, or the prior predictive) is immediately obtained by summation. It is the prime result of the computation, and is accompanied by an estimate of numerical uncertainty. Samples from the posterior distribution are an optional byprod...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2002